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2015  QUICKCOMPASS  OF  SEXUAL  ASSAULT  PREVENTION 
AND  RESPONSE-RELATED  RESPONDERS: 

STATISTICAL  METHODOLOGY  REPORT 

Introduction 

This  report  describes  the  sampling  and  weighting  methodologies  used  in  the  2015 
QuickCompass  of  Sexual  Assault  Prevention  and  Response-Related  Responders  (2015  QSAPR). 
This  survey  was  administered  by  the  Defense  Research,  Surveys,  and  Statistics  Center  (RSSC) 
within  the  Defense  Manpower  Data  Center  (DMDC)  as  part  of  the  QuickCompass  program  that 
supports  the  personnel  needs  of  the  Under  Secretary  of  Defense  for  Personnel  and  Readiness 
(USD  P&R). 


Sample  Design  and  Selection 


Target  Population 

The  target  population  of  the  2015  QSAPR  consists  of  Defense  Sexual  Assault  Advocate 
Certification  Program  (D-SAACP)  certified  Sexual  Assault  Response  Coordinators  (SARCs)  and 
SAPR  Victim  Advocates  (VAs)  who  are  active  duty.  National  Guard/Reserve  members,  or  DoD 
civilian  employees,  in  the  Army,  Navy,  Marine  Corps,  Air  Force,  or  DoD  agencies.  The  DoD 
Sexual  Assault  Prevention  Response  Office  (SAPRO)  provided  RSSC  a  list  of  certified  SARCs 
and  VAs  in  the  D-SAACP  as  of  June  22,  1015. 

Sampling  Frame 

The  2015  QSAPR  was  requested  by  SAPRO  to  provide  information  on  the  effectiveness 
of  the  current  Sexual  Assault  Prevention  and  Response  (SAPR)  programs  from  the  perspective  of 
primary  responders  -SARCs  and  VAs  performing  daily  duties.  The  population  was  provided  by 
SAPRO  and  consisted  of  32,106  certified  SAPR  responders:  1,868  SARCs  and  30,034  VAs 
(204  did  not  have  their  position  listed)  across  active  duty,  National  Guard/Reserve,  and  civilian 
populations.  Because  SARC  and  VA  positions  are  not  identified  on  DMDC  administrative  files, 
RSSC  was  unable  to  independently  determine  how  effectively  the  sampling  frame  covers  the 
target  population  but  assumed  that  the  population  provided  by  SAPRO  was  comprehensive. 

Sample  Design 

The  survey  was  a  census  of  all  32,106  SARCs  and  VAs  on  the  D-SAACP  file.  Sampled 
members  became  ineligible  if  they  indicated  on  the  survey  or  by  other  contact  (e.g.,  calling  the 
data  collection  contractor)  that  they  are  not  currently  a  SARC  or  VA  (4%  of  the  sample  -  1,426 
members).  Key  variables  are  shown  in  Table  1  for  the  2015  QSAPR.  Table  2  provides  the 
sample  size  frequencies  by  key  variable. 
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Table  1. 

Variables  for  Key  Reporting  Domains 


Variable 

Variable  Name 

Categories 

SAPR  Position 

CPOSIT 

VA 

SARC 

Current  Status 

CSTATUS 

Active  Duty 

Civilian 

National  Guard/Reserve 

Service 

CSERVICE 

Army 

Navy 

Marine  Corps 

Air  Force 

DoD 

Table  2. 

Sample  Size  by  Key  Variables 


Position 

Total 

Active 

Duty 

Civilian 

National 

Guard/ 

Reserve 

Army 

Navy 

Marine 

Corps 

Air  Force 

DoD 

SARC 

1,868 

1,085 

456 

327 

1,210 

121 

129 

401 

7 

VA 

30,034 

25,665 

1,183 

3,166 

14,400 

9,101 

2,783 

3,709 

41 

Total 

31,902 

26,750 

1,639 

3,493 

15,610 

9,222 

2,912 

4,110 

48 

Note:  There  were  204  members  missing  a  SAPR  position  ( CPOSIT).  There  were  219  members  missing  their  current  status  in  the  military 
(CSTATUS)  and  199  members  missing  a  Service  (CSERVICE). 


Survey  Administration 

The  2015  QSAPR  survey  was  administered  from  September  8,  2015  to  October  15,  2015. 
Refer  to  the  2015  QSAPR  Tabulation  Volume  (DMDC,  2015)  for  more  details  regarding  survey 
administration. 


Weighting 

Analytical  weights  for  the  2015  QSAPR  were  created  to  account  for  varying  response 
rates  among  population  subgroups.  The  base  weights  for  all  members  in  the  2015  QSAPR  are 
1.0  (100%  chance  of  selection),  which  are  then  adjusted  for  nonresponse  (eligibility  and 
completion).  The  adjusted  weights  were  then  poststratified  to  match  population  totals  and  to 
reduce  bias  unaccounted  for  by  the  previous  weighting  steps. 

Case  Dispositions 

Case  dispositions  were  assigned  to  each  sampled  member  for  weighting  based  on 
eligibility  for  the  survey  and  completion  of  the  return.  Execution  of  the  weighting  process  as 
well  as  computation  of  response  rates  both  depend  on  this  classification.  Case  dispositions  for 
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weighting  are  determined  using  information  from  personnel  records,  field  operations  (the  Survey 
Control  System,  or  SCS),  and  returned  surveys.  No  single  source  of  information  is  both 
complete  and  correct.  Inconsistencies  among  these  sources  are  resolved  according  to  the  order 
of  the  precedence  given  in  Table  3. 

The  order  of  execution  is  critical  to  resolving  case  dispositions.  For  example,  suppose  a 
sample  person  refused  the  survey,  with  the  reason  that  it  was  too  long;  in  the  absence  of  any 
other  information,  the  disposition  would  be  “eligible  nonrespondent”  (SAMP_DC=8).  If  a  proxy 
reported  that  the  sample  person  had  been  hospitalized  and  was  unable  to  complete  the  survey,  the 
disposition  would  be  “ineligible”  (SAMP_DC=2).  The  case  dispositions  for  2015  QSAPR  are 
shown  in  Table  3. 


Table  3. 

Case  Dispositions  for  Weighting 


Case  Disposition 
(SAMP_DC) 

Information 

Source 

Conditions 

Sample 

Size 

1 .  Record  ineligible 

SAPRO 

File  from  SAPRO  all  members  assumed  eligible. 

0 

2.  Ineligible  by  self- 
or  proxy-report 

Survey  Control 
System  (SCS) 

Self  or  proxy  reported  that  member  was  "Retired,"  “No 
longer  employed  by  DoD,”  or  “Deceased.” 

24 

3.  Ineligible  by 

survey  self-report 

Survey  eligibility 
questions 

Deemed  ineligible  based  on  survey  self  report  on  Question 

1,  “Are  you  currently  serving  as  a  certified  Sexual  Assault 
Response  Coordinator  (SARC)  or  Victim  Advocate  (VA)?” 

1,402 

4.  Eligible,  complete 
response 

Item  response  rate 

Respondent  completed  at  least  50  percent  of  survey 
questions. 

5,322 

5.  Eligible, 
incomplete 
response 

Item  response  rate 

Respondent  completed  less  than  50  percent  of  survey 
questions. 

1,058 

8.  Active  refusal 

SCS 

Reason  survey  is  blank  is  "refused-too  long",  “refused- 
inappropriate/intrusive"  ,  "refused-other" ,  "ineligible -other" , 
"unreachable  at  this  address",  "refused  by  current  resident", 
"concerned  about  security/confidentiality." 

91 

9.  Blank  return 

SCS 

No  reason  given. 

102 

10.  PND 

SCS 

Postal  non-deliverable  or  original  non-locatable. 

3,511 

11.  Non-respondent 

Remainder 

Remaining  blank  surveys. 

20,596 

Total 

32,106 

Table  4  shows  the  5,322  complete  eligible  respondents’  status  and  Service  by  SAPR 
position.  As  discussed  in  Table  2  all  of  the  key  variables  had  some  degree  of  missingness:  there 
were  64  missing  for  SAPR  position  (CPOSTT),  69  missing  for  active  status  (CSTATUS),  and  63 
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missing  for  Service  (CSERVICE).  RSSC  imputed  for  these  key  variables  based  on  the  complete 
eligible  respondents  answer  to  the  corresponding  survey  question.  For  instance,  if  a  member  was 
missing  on  position  (CPOSIT),  but  responded  as  a  VA,  they  would  be  imputed  as  a  VA.  This 
method  was  used  for  position,  status,  and  Service.  Following  this  imputation,  there  were  only  12 
missing  for  CSERVICE.  These  12  respondents  with  missing  service  were  placed  into 
appropriate  poststratification  cells  and  final  complete  eligible  respondents  are  shown  in  the  table 
below. 


Table  4. 

Complete  Eligible  Respondents  by  Key  Variables 


Position 

All 

Active 

Duty 

Army 

Navy/ 

Marines 

USAF 

National 

Guard/ 

Reserve 

Civilian 

SARC 

520 

246 

186 

28 

32 

98 

176 

VA 

4,802 

3,715 

1,592 

1,523 

600 

719 

368 

Total 

5,322 

3,923 

1,778 

1,551 

632 

817 

544 

Nonresponse  Adjustments  and  Final  Weights 

After  case  dispositions  were  resolved,  the  sampling  weights  were  adjusted  for 
nonresponse.  The  sampling  weights  for  the  2015  QSAPR  took  the  value  of  one  (1.0)  because  it 
was  a  census.  The  sample  weights  were  adjusted  for  nonresponse  in  the  two  following  steps: 

•  Step  1:  Adjust  weights  for  nonresponse  based  on  eligibility  as  follows: 

—  Transfer  the  weight  of  the  24,300  nonrespondents  (SAMP_DC  =  8,  9,  10,  1 1)  to 
the  7,806  cases  with  known  eligibility  (SAMP_DC  =  2,  3,  4,  5).  Chi-squared 
Automatic  Interaction  Detection  (CHAID),  a  decision-tree  technique  based  on 
Chi-square  tests,  was  used  to  determine  the  best  predictors  for  the  logistic  model. 
A  logistic  regression  model  was  used  to  predict  the  probability  of  eligibility  for 
the  survey  (known  eligibility  vs.  unknown  eligibility).  Weighting  adjustment 
factors  for  eligibility  were  computed  as  the  inverse  of  the  logistic  model-predicted 
probabilities.  The  model  was  weighted  using  the  sampling  weight/base  weight 
(1.0  in  each  case  since  this  was  a  census).  Predictors  in  the  CHAID  model  are 
shown  in  Table  5. 

•  Step  2:  Adjust  weights  for  survey  completion  as  follows: 

—  Transfer  the  eligibility  weight  (created  in  Step  1)  of  the  1,058  incomplete  survey 
responses  (SAMP_DC  =  5)  to  the  5,322  complete-eligible  respondents 
(SAMP_DC  =  4).  Weighting  adjustments  for  completion  use  the  same 
methodology  as  Step  1  (CHAID  and  logistic  model). 
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Step  3:  Create  final  weights 


—  RSSC  calculated  the  final  weight  as  the  product  of  adjustment  factors  in  Steps  1 
and  2.  The  weights  were  poststratified  to  match  population  totals  and  to  reduce 
bias  unaccounted  for  by  the  previous  weighting  adjustments.  Poststratification 
cells  were  defined  by  the  cross-classification  of  position  (SARC  or  VA),  status 
(Active,  Reserve,  Civilian),  and  Service.  Many  of  the  crossings  were  collapsed 
since  the  goal  was  to  create  poststratification  cells  with  more  than  30  respondents. 
Within  each  post-stratification  cell,  the  non-response-adjusted  weights  for  eligible 
respondents  and  self-reported  ineligibles  (SAMP_DC  =  2,  3,  4)  were  adjusted  to 
match  population  counts.  Table  6  shows  the  three  variables  used  for 
poststratification. 

RSSC  observed  large  differences  between  the  administrative  position  data  (SARC  or  VA) 
reported  on  D-SAACP  and  the  estimated  number  within  each  position  based  on  self  report. 
Respondents  were  classified  primarily  by  survey  self-report  data.  If  the  self-reported  data  were 
missing,  then  D-SAACP  data,  at  the  time  of  sampling,  were  used  to  impute  the  subgroup 
classification.  For  example,  the  estimated  population  is  higher  for  SARCs  (n=2,935)  than  the 
number  of  SARCs  originally  identified  in  the  D-SAACP  file  (n=l,887).  This  increase  in  SARCs 
is  due  to  a  large  number  of  respondents  originally  identified  on  the  population  frame  as  a  VA 
(n=360)  self-reporting  as  a  SARC  on  the  survey.  RSSC  uses  the  administration  data  to  weight 
up  to  the  population  and  the  survey  responses  to  produce  estimates,  and  therefore  the  estimated 
population  of  SARCs  is  larger  than  the  original  population  file. 
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Table  5. 

Variables  Used  for  the  Eligibility  and  Completion  Adjustments 


Variable 

Variable  Name 

Categories 

SAPRO  Position 

CPOSIT 

SARC 

VA 

Service 

CSERVICE 

Army 

Navy 

Marine  Corps 

Air  Force 

DoD 

Status 

CSTATUS 

Active  duty 

National  Guard  /  Reserve 

Civilian 

Occupation  Group 

OCCGROUP 

Best  Responders 

Good  Responders 

Average  Responders 

Poor  Responders 

Worst  Responders 

Race 

CRACE_ETH 

White 

Black 

Hispanic 

All  Others 

Education 

CEDUC 

No  College 

Some  College 

4-year  Degree 

Grad/Professional  Degree 

Age 

CAGE5 

18  to  24  years  olds 

25  to  30  years  olds 

31  to  34  years  olds 

35  to  40  years  olds 

41  years  old  and  older 

Gender 

CSEX 

Male 

Female 

Paygrade 

GRADE 

Uncollapsed  paygrades,  30  levels  ranging  from  E-01  (Junior  Enlisted) 
to  0-08  (General  level)  as  well  as  Civilian  paygrades  (GS-04  to  GS- 
15) 

Civilian/Reserve 

Program 

ALL  CD 

Collapsed  Reserve  and  Civilian  programs 
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Table  6. 

Variables  used  for  Poststratification 


Variable 

Variable  Name 

Categories 

SAPRO  Position 

CPOSIT 

SARC 

VA 

Service 

CSERVICE 

Army 

Navy 

Marine  Corps 

Air  Force 

DoD 

Status 

CSTATUS 

Active  duty 

National  Guard  /  Reserve 

Civilian 

Table  7  provides  summaries  of  the  distributions  of  the  sampling  weights  (all  are  1), 
intermediate  weights,  final  weights,  and  adjustment  factors  by  eligibility  status.  Eligible 
respondents  are  those  individuals  who  were  1)  eligible  to  participate  in  the  survey,  and  2) 
completed  50%  of  the  survey  items  asked  of  all  respondents  (SAMP_DC=4).  Self/Proxy 
ineligibles  are  those  determined  to  be  ineligible  (SAMP_DC  =  2  or  3),  while  the  nonrespondents 
include  the  incomplete  eligibles,  refusals,  returned  blank  surveys,  unreachables  and  other 
nonrespondents  (SAMP_DC  =  5  through  11).  There  were  no  record  ineligible  individuals 
(SAMP_DC=1)  since  the  population  file  was  provided  by  SAPRO  and  it  was  assumed  that  all 
members  were  eligible. 
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Table  7. 

Distribution  of  Weights  and  Adjustment  Factors  by  Eligibility  Status 


Eligibility 

Status 

Statistic 

Sampling 

Weight 

Eligibility 

Status 

Adjusted 

Weight 

Complete 

Eligible 

Response 

Adjusted 

Weight 

Final 
Weight 
With  Non¬ 
response 
and 

Poststrati¬ 

fication 

Factors 

Eligibility 

Status 

Factor 

Complete 

Eligible 

Response 

Factor 

Poststrati¬ 

fication 

Factor 

Eligible 

Respondents 

N 

5,322 

5,322 

5,322 

5,322 

5,322 

5,322 

5,322 

MIN 

1 

1.64 

1.87 

1.53 

1.64 

1.14 

0.81 

MAX 

1 

9.60 

12.45 

12.64 

9.60 

1.30 

1.04 

MEAN 

1 

4.10 

4.93 

4.96 

4.10 

1.20 

1.00 

Self/Proxy 

Ineligibles 

N 

1,426 

1,426 

1,426 

1,426 

1,426 

0 

1,426 

MIN 

1 

1.64 

1.64 

0 

1.60 

0 

MAX 

1 

9.60 

9.60 

9.82 

9.60 

1.04 

MEAN 

1 

4.00 

4.00 

4.02 

4.00 

1.00 

Nonresponde 

nts 

N 

25,358 

25,358 

25,358 

25,358 

25,358 

1,058 

0 

MIN 

1 

0 

0 

0 

0 

0 

MAX 

1 

9.60 

0 

0 

9.60 

0 

MEAN 

1 

0.18 

0 

0 

0.18 

0 

Table  8  displays  the  sums  of  sampling  weights,  intermediate  weights  (eligibility  and 
completion),  and  final  weights  by  eligibility  status. 


Table  8. 

Sum  of  Weights  by  Eligibility  Status 


Eligibility  Category 

Sum  of  Sampling 
Weights 

Sum  of 

Eligibility  Status 
Adjusted 
Weights 

Sum  of  Complete 
Eligible 
Response 
Adjusted 
Weights 

Sum  of  Final 
Weights  With 
Nonresponse  and 
Poststratification 
Adjustments 

1 .  Eligible  weighted 

5,322 

21,838 

26,239 

26,374 

2.  Ineligible  weighted 

1,426 

5,714 

5,714 

5,732 

3.  Non-response  unweighted 

25,358 

4,554 

0 

0 

4.  Record  ineligible 
unweighted 

0 

0 

0 

0 

Total 

32,106 

32,106 

31,953 

32,106 

Variance  Estimation 


Analysis  of  the  2015  QSAPR  data  required  a  variance  estimation  procedure  that 
accounted  for  the  weighting  procedures.  The  final  step  of  the  weighting  process  was  to  define 
strata  for  variance  estimation  by  Taylor  series  linearization.  The  2015  QSAPR  variance 
estimation  strata  corresponded  closely  to  the  crossing  of  position  (SARC  and  VA),  status 
(Active,  Reserve,  Civilian),  and  Service;  however,  it  was  necessary  to  collapse  some  of  the 
crossings  containing  fewer  than  25  complete  eligible  responses  with  non-zero  final  weights. 
Eleven  variance  estimation  strata  were  defined  for  the  2015  QSAPR. 


Multiple  Comparison  Section 

When  statistically  comparing  groups  (e.g..  Army  vs.  Average  of  the  other  Services 
estimates  of  the  effectiveness  of  training),  a  statistical  hypothesis  whether  there  are  no 
differences  (null  hypothesis)  versus  there  are  differences  (alternative  hypothesis)  is  tested. 

RSSC  often  uses  independent  two  sample  t-tests  for  its  statistical  tests.  The  conclusions  are 
usually  based  on  the  p-value  associated  with  the  test-statistic.  If  the  p-value  is  less  than  the 
critical  value  then  the  null  hypothesis  is  rejected.  Any  time  a  null  hypothesis  is  rejected 
(conclude  that  estimates  are  significantly  different),  it  is  possible  this  conclusion  is  incorrect.  In 
reality,  the  null  hypothesis  may  have  been  true,  and  the  significant  result  may  have  been  due  to 
chance.  A  p-value  of  0.05  means  there  is  a  five  percent  chance  of  finding  a  difference  as  large  as 
the  observed  result  if  the  null  hypothesis  were  true. 

In  survey  research  there  is  interest  in  conducting  multiple  comparisons.  For  example,  1) 
testing  whether  the  satisfaction  with  the  safety  training  among  Army  SARCs  and  VAs  is  the 
same  as  the  satisfaction  with  all  other  Services,  and  2)  testing  the  satisfaction  with  the  safety 
training  among  Navy  SARCs  and  VAs  is  the  same  as  the  satisfaction  with  all  other  Services  and 
so  on.  When  performing  multiple  independent  comparisons  on  the  same  data  the  question 
becomes:  “Does  the  interpretation  of  the  p-value  for  a  single  statistical  test  hold  for  multiple 
comparisons?”  If  200  independent  statistical  (significance)  tests  were  conducted  at  the  0.05 
significance  level,  and  the  null  hypothesis  is  supported  for  all,  10  of  the  tests  would  be  expected 
to  be  significant  at  the  p-value  <  0.05  level  simply  due  to  chance.  These  10  tests  would  have 
incorrectly  assumed  to  be  statistically  significant — known  as  false  positives  or  false  discoveries. 
When  a  single  significance  test  is  conducted,  the  error  rate — the  probability  of  false 
discoveries — is  the  p-value  itself.  When  more  than  one  significance  test  is  conducted,  the 
probability  of  false  discoveries  increases,  i.e.,  the  more  tests  that  are  conducted  the  greater  the 
number  of  false  discoveries. 

This  is  known  as  the  “multiple  comparisons  problem.”  Therefore,  it  is  important  to 
control  the  false  discoveries  when  performing  multiple  independent  tests  to  reach  more  accurate 
conclusions.  Numerous  techniques  have  been  developed  to  control  the  false  positive  error  rate 
associated  with  conducting  multiple  statistical  tests  (multiple  comparisons)  and  there  is  no 
universally  accepted  approach  for  dealing  with  it. 
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The  method  that  RSSC  uses  to  control  for  false  discoveries  is  known  as  False  Discovery 
Rate  correction  (FDR)  developed  by  Benjamini  and  Hochberg  (1995).  FDR  is  defined  as  the 
expected  percentage  of  erroneous  rejections  among  all  rejections.  The  goal  is  to  control  the  false 
discovery  rate  which  is  the  proportion  of  “discoveries”  (significant  results)  that  are  actually  false 
positives.  The  approach  can  be  summarized  as  follows: 

•  determine  the  number  of  comparisons  (tests)  of  interest,  call  it  m; 

•  determine  the  tolerable  False  Discovery  Rate  (FDR  Rate),  call  it  a; 

•  calculate  the  p-value  for  each  statistical  test; 

•  sort  the  individual  p-values  from  smallest  to  largest  and  rank  them,  call  the  rank  k\ 

•  for  each  ranked  p-value  calculate  the  FDR-adjusted  alpha  (threshold)  which  is 
defined  as  ; 

m 

•  determine  the  cutoff  delineating  statistically  significant  results  from  non-significant 
results  in  the  sorted  file  as  follows:  look  for  the  maximum  rank  (k)  such  that  the 
ordered  p-value  is  less  than  the  FDR-adjusted  alpha  (i.e.,  look  for  the  maximum  k 
after  which  the  p-value  becomes  greater  than  the  threshold),  call  this  maximum  k  the 
cutoff.  Any  comparison  (p-value)  with  rank  less  than  the  cutoff  is  considered 
statistically  significant. 

RSSC  computed  the  FDR  thresholds  (FDR  adjusted  alpha)  for  the  current  year  (2015) 
and  implemented  FDR  Multiple  Comparison  corrections  to  control  the  expected  rate  of  false 
discoveries  (Type  I  errors)  at  oc  =  0.05.  For  the  current  year  estimates,  RSSC  performed  12,377 
separate  statistical  tests  (e.g..  Army  vs.  Average  of  the  other  Services  estimates  of  the 
effectiveness  of  the  training).  Of  the  12,377  current  year  statistical  tests,  6,059  were  statistically 
significant. 


Location,  Completion,  and  Response  Rates 

Location,  completion,  and  response  rates  were  calculated  in  accordance  with  the 
recommendations  of  the  American  Association  for  Public  Opinion  Research  (AAPOR,  2015 
Standard  Definitions),  which  estimates  the  proportion  of  eligible  respondents  among  cases  of 
unknown  eligibility. 

The  location  rate  (LR)  uses  the  AAPOR  standard  formula  for  the  contact  rate  (CON2) 
and  is  defined  as 

(I  +  P)  +  R  +  e(UO)  adjusted  located  sample  N, 

L/iv  —  —  —  . 

(/  +  P)+  R  +  NC  +  e(UO)  adjusted  eligible  sample  NE 
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The  completion  rate  (CR)  uses  AAPOR  standard  formula  COMR  and  is  defined  as 


_  (/  +  P)  _  usable  responses  _  NR 

(I  +  P)  +  R  +  e(UO)  adjusted  located  sample  N , 

The  response  rate  (RR)  uses  AAPOR  standard  formula  RR4  and  is  defined  as 

_  (/  +  P)  _  usable  responses  _  NR 

(/  +  P)+R  +  NC  +  e{UO)  adjusted  eligible  sample  N E 


Where 


I  =  Fully  complete  responses  according  to  RR4  (  >  80%  complete) 

P  =  Partially  complete  responses  according  to  RR4  (  50  -  80%  complete) 

R  =  Refusal  and  break-off  according  to  RR4  (  <  50%  complete) 

NC  =  Non-contact 

e(UO)  =  Estimated  eligibility  of  cases  unknown 
Nl  =  Adjusted  located  sample 
Ne  =  Adjusted  eligible  sample 
Nr  =  Usable  responses 

Table  9  shows  the  corresponding  sample  disposition  codes  associated  with  the  response 
categories. 


Table  9. 

Disposition  Codes  for  Response  Rates 


Response  Category 

SAMP_DC  Values 

Eligible  Sample 

4,  5.  8.  9.  10.  11 

Located  Sample 

4,  5.  8.  9.  11 

Usable  Response 

4 

Not  Returned 

11 

Eligibility  Determined  Cases 

2,  3,4,5.  8,9 

Self  Report  Ineligible  Cases 

2,  3 

11 


Ineligibility  Rate 


The  ineligibility  rate  (IR)  is  defined  as  the  following  and  needs  to  be  calculated  for  both 
weighted  and  unweighted  to  be  applied  to: 

IR  =  Self  Report  Ineligible/Eligibility  Determined. 

Estimated  Ineligible  Postal  Non-Deliverable/Not  Located  Rate 

The  estimated  ineligible  postal  non-deliverable  or  not  located  (IPNDR)  is  defined  as: 
IPNDR  =  (Eligible  Sample  -  Located  Sample)  *  IR. 

Estimated  Ineligible  Nonresponse 

The  estimated  ineligible  nonresponse  (EINR)  is  defined  as: 

EINR  =  (Not  Returned)  *  IR. 


Adjusted  Location  Rate 

The  adjusted  location  rate  (ALR)  is  defined  as: 

ALR  =  (Located  Sample  -  EINR)/(Eligible  Sample  -  IPNDR  -  EINR). 

Adjusted  Completion  Rate 

The  adjusted  completion  rate  (ACR)  is  defined  as: 

ACR  =  (Eligible  Response)/(Located  Sample  -  EINR). 

Adjusted  Response  Rate 

The  adjusted  response  rate  (ARR)  is  defined  as: 

ARR  =  (Eligible  Response)/(Eligible  Sample  -  IPNDR  -  EINR). 

Table  10  shows  the  weighted  sampled  counts  used  to  compute  the  overall  response  rates. 

The  final  response  rate  is  the  product  of  the  location  rate  and  the  completion  rate.  Table 
11  shows  both  weighted  and  unweighted  location,  completion,  and  response  rates  for  the  2015 
QSAPR. 

Finally,  Table  12  shows  weighted  location,  completion,  and  response  rates  for  the  full 
sample  by  the  stratification  variables.  As  can  be  seen  the  final  weighted  response  rate  for  2015 
QSAPR  is  20%,  which  is  similar  to  responses  rates  obtained  on  RSSC’s  Status  of  Forces  Surveys 
and  other  military  surveys  conducted  by  RSSC. 
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Table  10. 

Comparison  of  the  Final  Weighted  Respondents  Relative  to  the  Drawn  Sample 


Case  Disposition  Categories 

Sample  Counts 

Weighted  Estimates 

Count 

Percent 

Count 

Percent 

Drawn  sample  and  population 

32,106 

100 

32,106 

100 

Ineligible  on  master  files 

0 

0 

0 

0 

Self-reported  ineligible 

-1,426 

4.4 

-1,426 

4.4 

Total:  Ineligible 

-1,426 

4.4 

-1,426 

4.4 

Eligible  sample 

30,680 

95.6 

30,680 

95.6 

Not  located  (estimated  ineligible) 

-626 

1.9 

-626 

1.9 

Not  located  (estimated  eligible) 

-2,885 

9.0 

-2,885 

9.0 

Total  not  located 

-3,511 

10.9 

-3,511 

10.9 

Located  sample 

27,169 

84.62 

27,169 

84.62 

Requested  removal  from  survey  mailings 

-91 

0.3 

-91 

0.3 

Returned  blank 

-102 

0.3 

-102 

0.3 

Skipped  key  questions 

-1,058 

3.3 

-1,058 

3.3 

Did  not  return  a  survey  (estimated  ineligible) 

-3,672 

11.4 

-3,672 

11.4 

Did  not  return  a  survey  (estimated  eligible) 

-16,924 

52.7 

-16,924 

52.7 

Total:  Nonresponse 

-21,847 

68.0 

-21,847 

68.0 

Eligible  responses 

5,322 

16.6 

5,322 

16.6 

Table  11. 

Location,  Completion,  and  Response  Rates 


Type  of  Rate 

Computation 

Unweighted 

Weighted 

Location 

Adjusted  located  sample/ Adjusted  eligible  sample 

89% 

89% 

Completion 

Usable  responses/ Adjusted  located  sample 

23% 

23% 

Response 

Usable  responses/ Adjusted  eligible  sample 

20% 

20% 
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Table  12. 

Rates  for  Full  Sample  and  Key  Variables 


Domain  Variable 

Domain 

Sample 

Size 

Eligible 

Responses 

Sum  of 
Weights 

Location 

Rate 

Completion 

Rate 

Response 

Rate 

Sample 

Sample 

32,106 

5,322 

32,106 

89% 

23% 

20% 

SAPRO  Position 

SARC 

1,868 

512 

1,868 

91% 

35% 

32% 

VA 

30,034 

4,746 

30,034 

89% 

22% 

19% 

Status 

Active  Duty 

26,754 

3,904 

26,754 

89% 

21% 

18% 

Reserve 

3,494 

808 

3,494 

89% 

28% 

25% 

Civilian 

1,639 

541 

1,639 

89% 

41% 

36% 

Service 

Army 

15,612 

2,675 

15,612 

87% 

26% 

22% 

Navy 

9,225 

1,175 

9,225 

88% 

16% 

14% 

Marine  Corps 

2,912 

486 

2,912 

97% 

21% 

20% 

Air  Force 

4,110 

912 

4,110 

95% 

26% 

25% 

DoD 

48 

11 

48 

90% 

31% 

28% 

Note:  For  the  Sample  Size  column  there  are  204  members  missing  a  SAPR  position  ( SARC/VA ).  There  are  219  members  missing  their  current 
status  in  the  military  ( Active ,  Reserve,  Civilian)  and  199  members  missing  a  Service.  Eligible  responses  with  missing  administrative  data  were 
imputed  based  on  the  members’  self-report  information. 
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